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Abstract — In this paper, we consider the electricity cost mini- 
mization problem in a residential network where each community 
is equipped with a distributed power generation source and every 
household in the community has a set of essential and shiftable 
power demands. We allow bi-directional power transactions and 
assume a two-tier pricing model for the buying and selling of elec- 
tricity from the grid. In this situation, in order to reduce the cost 
of electricity we are required to make, 1) Scheduling decisions for 
the shiftable demands, 2) The decisions on the amount of energy 
purchased from the gird by the users, 3) The decisions on the 
amount of energy sold to the grid by the users. We formulate a 
global centralized optimization problem and obtain the optimal 
amount of electricity consumed, sold and purchased for each 
household, respectively by assuming the availability of all current 
and future values of time-varying parameters. In reality, the lack 
of perfect information hampers the implementation of such global 
centralized optimization. Hence, we propose a distributed online 
algorithm which only requires the current values of the time- 
varying supply and demand processes. We then compare and 
determine the tradeoff between both formulations. Simulation 
results show that the proposed schemes can provide effective 
management for household electricity usage. 

Index Terms — Residential smart grid, distributed generation, 
bidirectional transactions, electricity cost and comfort tradeoff. 

I. Introduction 

While the traditional electricity grid has maintained its 
current state for many decades, there is a growing need 
to transit to a newer state with increasing demands from 
renewable energy integration and reducing dependency on 
fossil fuel. National governments and relevant industries have 
been making significant efforts in the development of future 
electrical grids or smart grids. A smart grid [1J-[3| is known 
as an intelligent electricity network that uses two-way flows 
of electricity and information to create an automated and 
distributed power delivery system which can help save energy, 
reduce costs, increase reliability and transparency. 

There are two significant advantages of the smart grid: 
improved integration for renewable energy (e.g. wind, solar 
energy) and increased capability for demand-side manage- 
ment. In residential households, the electricity generated from 
renewable distributed plants such as solar panels can help the 
consumer save on electricity costs and in systems supporting 



sell back policies like net metering, residents can even turn 
a profit by selling the extra renewable energy back to the 
power grid |4|. While typical renewable energy sources offer 
a cheaper and cleaner energy supply, they introduce supply 
uncertainty due to the volatility of their generation 151. It is 
therefore important to include a complementary technology 
__, or provide a mixture of traditional power to mitigate or 
cancel the volatility [7) __. 

Another way to mitigate this problem is to manage this 
supply variability with demand side flexibility __ iflOl . In 
__, the authors suggested that consumers who could tolerate 
serving delays within a pre-agreed deadline can be offered 
electricity at a lower price by renewable power suppliers. 
This essentially allows a lower price of renewable energy to 
consumers willing to provide this extra time flexibility. The 
renewable power supplier can now use this flexibility to deliver 
the energy when it is available. Based on this model, the 
authors in [10] investigated the problem of allocating energy 
from renewable sources to flexible consumers in electricity 
markets. The renewable plant must serve consumers within a 
specified delay window, and incurs a cost of drawing energy 
from other (possibly non-renewable) sources if its own supply 
is not sufficient to meet the deadline. An natural extension to 
this work involving consumer flexibility is the consideration of 
a distributed renewable energy source that allows consumers 
to not only consume power from the grid but sell it back too. 

In this paper, we consider the electricity cost minimization 
problem with a renewable based Distributed Generation (DG) 
and bidirectional power transactions in a residential smart 
grid. Each household is equipped with a mixed renewable 
power source which consists of both wind and solar generators. 
There are two types of appliances in each home: essential 
and shiftable appliances, which leads to essential and shiftable 
power demands in the entire residential system. We allow bi- 
directional power transactions and assume a dynamic pricing 
model for the buying and selling of electricity from the grid. 
In order to reduce the cost of electricity we are required to 
make, 1) Scheduling decisions for the shiftable demands, 2) 
The decisions on the amount of energy purchased from the 
grid by the users, 3) The decisions on the amount of energy 



sold to the grid by the users. 

We first formulate a global optimization problem and ob- 
tain the optimal amount of electricity consumed, sold and 
purchased for each household, by assuming the availability 
of all current and future values of time-varying parameters. 
Consequently, we propose a distributed online algorithm which 
only requires the current values of the time-varying supply 
and demand processes. A comparison of the simulation re- 
sults show that the proposed schemes can provide effective 
management for household electricity usage. 

The rest of the paper is organized as follows. In Section 
II, the system models are introduced. The formulation for 
the global optimization problem with perfect information is 
proposed in Section III. The distributed online algorithm with 
Lyapunov optimization is presented in Section IV. Section 
V presents the simulation results of the proposed schemes. 
Finally, we conclude the paper in Section VI. 

II. System Model 
A. Mixed Distributed Renewable Energy Source 

In this subsection, we present the models for the distributed 
energy sources modelled as a combination of both a photo- 
voltaic (PV) module and a wind turbine, modelled separately*. 

1 ) Output Power of a PV Module: The irradiance data for 
a particular day in each season can be described as a bimodal 
distribution function. The data are divided into two groups, 
each is described using a unimodal distribution function, and 
a Beta pdf is utilized as Q: 
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fb(s) = \ !»r(/3)* s * li s) (1) 
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where s is the solar irradiance (kW/m 2 ), fb(s) is the Beta 
distribution function of s and a, f3 are the parameters of the 
Beta distribution function. 

The output power of the PV module is dependent on the 
solar irradiance and ambient temperature of the site as well 
as the characteristics of the module itself. Therefore, once the 
Beta pdf per sitel is generated for a specific time segment, the 
output power during the different states is calculated for this 
segment using the following: 
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where T c is the cell temperature °C during state y, Ta is 
the ambient temperature °C, K v is the voltage temperature 
coefficient V/°C; Ki is the current temperature coefficient 
A/°C; Not is the nominal operating temperature of cell in 
°C; FF is the fill factor; I sc is the short circuit current in A; 
Voc is the open-circuit voltage in V; Impp is the current at 
maximum power point in A; Vmpp is the voltage at maximum 
power point in V; P s is the output power of the PV module 
during state y; s ay is the average solar irradiance of state y. 



2) Output Power of a Wind Turbine: The wind speed profile 
is used to generate a corresponding output power for use in the 
distributed power generation. Rayleigh pdf is used to represent 
the wind speed profile for each time segment, given as: 
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where c = 1.128u m . 

The output power of a wind turbine is dependent on the 
wind speed at the site as well as the parameters of its 
power performance curve. Therefore, once the Rayleigh pdf is 
generated for a specific time segment, the output power during 
the different states is calculated for this segment as Q: 
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where v C i, v r and v co are cut in speed, rated speed, and cut-off 
speed of the wind turbine, respectively, Pv w {v aw ) is output 
power of the wind turbine during state w, v aw is average wind 
speed of state. 

To incorporate the output power of the solar PV DG and 
wind turbine DG units as multistate variables in the global 
formulation, the continuous pdf of each has been divided into 
states (periods), in each of which the solar irradiance and wind 
speed are within specific limits. In other words, for each time 
segment, there are a number of states for the solar irradiance 
and wind speed. The probability of the solar irradiance and 
wind speed generation for each state during any specific hour 
is calculated as follows: 

fl s (G y ) = [ ^ f b {s)ds 7 (5) 
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where fl s (G y ) is the probability of the solar irradiance being 
in state y; tt v (G w ) probability of wind speed being in state 
W, s y i and s y 2 are the solar irradiance limits of state y; v w \ 
and v W 2 are the wind speed limits of state w. 

Assuming that wind speed states and solar irradiance states 
are independent, the probability of any combination of them 
(il{C g }) is obtained by convolving the two probabilities: 

Sl{C g } = Sl s {G y )*n v {G w ). (7) 

We define a supply function S(t) to indicate the energy 
generated by the renewable sources at time t, and obtain 

G 

S(t) =Y,PgMC g } (8) 
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where P g t is the mixed power of the g state at time t. We 
have a maximum limit on the electricity that can be generated 
by the renewable plant i.e. < S(t) < S max ,Vt. 

* The value of all of the parameters related to PV module and wind turbine 
is refer to (5). 



B. Residential Smart Grid Model 

Let M denote the set of users in a residential network, 
where the number of users, each representing one household 
is N = | Af | . We consider the residential smart grid in which 
the electricity from the power grid and renewable sources 
are shared by these N users (homes), each one of which is 
equipped by a smart meter. The smart meter connects with all 
the household appliances and not only manages the electricity 
flow, but also schedules the power consumption of each appli- 
ance in terms of the collected user's preference information. 
Based on all the collected information, a centralized scheduler 
will globally optimize the hourly power consumption and 
schedule all appliances. 

The appliances that define a household are divided into two 
types: essential and shiftable appliances. Essential appliances 
are defined as appliances that have a fixed energy require- 
ment that would not be subjected to scheduling decisions. 
These appliances include television sets and refrigerators. The 
optimization process would ensure a continuous supply of 
electricity for these. Shiftable appliances allow the smart meter 
to schedule electricity loads to minimize electricity cost. These 
appliances could include dishwashers, washing machines and 
clothes dryers. We denote the total essential and shiftable load 
for the nth user at time t as a n e (i) and a n , s (t), respectively. 
Then, the total essential and shiftable load across all users at 
time t can be respectively calculated as 



A e (t) = 
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C. Delay-Aware Power Transactions 

In our model, the energy produced by the distributed energy 
source at time t can either be used to serve essential demand, 
shiftable demand or can be sold to the grid. Let S e (t) 
and S s (t) denote the electricity taken from the renewable 
plant to satisfy the essential and shiftable demand at time t, 
respectively. Let S p (t) denote the electricity that is sold by 
the customer to the grid at time t. Then, we have 

S e (t) + S s (t) + S p (t) = S(t), Vi. 

However, the renewable energy may not be enough to meet 
all of the requests within a timely manner, and hence we also 
decide to purchase an amount of electricity from the power 
grid. Let G(t), G e (t) and G s (t) denote respectively the total 
electricity purchased from the grid, the portion of electricity 
taken from grid to serve essential and shiftable loads at time 
t, we have, 

G(t) = G e (t) + G s (t), Vt. 

Meanwhile, in order to formulate the problem mathematically, 
we put a limit on max power that can be purchased from the 
grid, i.e. < G(t) < G max ,Vt- 

Let p(t) denote the cost of electricity taken from the grid 
at time t. Let 7(f) denote the price set by the grid to purchase 
electricity at time t. The instantaneous cost of electricity at 
time t, denoted by C(t), is then given by, 



C(t)= P (t)G(t)- 1 (t)S p (t) 

= p(t)[G e (t) + G s (t)} - j(t)[S{t) - S e (t) - S s (t)}. 

(9) 

We assume that shiftable loads are flexible, and can tolerate 
their demands being satisfied with some delay. We store all 
the shiftable demands in a queue. The electricity demands in 
this queue are served in a FIFO manner and the queue is then 
updated according to: 

Q{t + 1) = max S.Q(t) - G s (t) - S s (t), J + A s (t). 
Let Q denote the expected time average of the demand queue, 
Q = liiriT^oo — Ei Q(t) \ < Q max . 



t=o 



The demands are served with finite delays if Q max < 00. 

III. Problem Formulation 

Our objective now is to minimize the expected time average 
cost of electricity subject to satisfying the essential demands 
and guaranteeing the shiftable demands with a worst case 
delay bound D max . The optimization problem can now be 
formulated as follows, 

1 T_1 
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subject to, 
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where C(t) is given by (0. The backward dynamic program- 
ming approach can be used to solve problem ([Tol l subject 
to the constraint set (fTlTi-(fl5]l. The state vector is given 
by x t = (S t ,A ett ,A Stt ,p t ,f t ), where S t is the renewable 
supply, A e> t and A s , t are the essential and shiftable demand 
respectively, and p t , j t are the market price for buying and 
selling electricity respectively. Our control is assumed as u t = 
(G e ,t,G Si t, S e ,t, S s ,t), the backward dynamic programming 
algorithm is given by the following equation J9]: 



J t {x) — min ^ C(x, U t ) 
u t eu t {x) 
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where Jt(x) is the value function of period t, C(x,Ut) = 
Pt(G e ,t + G s>t ) - 7 t (5t - S e ,t ~ S Syt ) is the electricity cost 
incurred at each period, Ut(x) is the feasible region of actions 
for period t, and Y t is the feasible region of the state vector 
at period t. 

Since the dynamic programming need global information to 
solve the problem which may have the disadvantage to capture 



the time-varying characteristics of the demand and supply in 
renewable related residential networks. It stands to reason 
that an algorithm that can make optimal decision without 
the knowledge of future information should be designed. 
Inspired by iflOl . we design a distributed online algorithm 
which will utilize a Lyapunov optimization technique to solve 
the optimization problem in a distributed way without a-priori 
statistical knowledge. 

IV. Distributed Online Algorithm 

A. Lyapunov Optimization 

Let P* denote the infimum time average cost of the above 
problem. The requirement of Q < oo in the above problem 
does not guarantee a delay bound D max . To ensure this bound 
a delay aware virtual queue is developed. This delay aware 
virtual queue has the same service rate as that of the actual 
queue but it grows if the demand is not serviced at time t. 
The virtual queue update equation is, 



{Q( t )>o}<°j < 16) 
is an indicator function. The value of this 



Z(t+1) = max <J Z(t)-G s (t)-S s {t)+el 
where, 1 



{Q(t)>o} 

function is 1 if Q(t) > and otherwise. Thus the delay 
aware queue grows by an amount e each time it is not serviced. 
With the introduction of delay aware virtual queue we have 
the following Lemma |9). 

Lemma 1: If Z(t) < Z max and Q(t) < Q ma x, then all 
shiftable devices will get scheduled with a worst case delay 
of D max where, 

Z„ 

^ max — 



Let 8(i) = (Z(t),Q(t)) denote the concatenated vector of 
virtual and real queues. We then define the following Lyapunov 
function to measure the congestion in the queues, 

Lm)) = \[z 2 {t) + Q\t)]. 

The conditional 1-slot Lyapunov drift is defined as, 

A(Q(t)) = E^L(e(t + l))-L(Q(t))\Q(t) 

Define V > as a parameter to effect the performance delay 
tradeoff, we have the following drift plus penalty function, by 
using the drift plus penalty framework developed in [9|, 



A(Q(t)) + VEiC(t)\Q(t) 



where C{t) is given by (0. Again using the same techniques 
in (9) we can show that this function is bounded as, 
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Now instead of solving the original problem we minimize this 
bound on the drift plus penalty function. 

B. Two-Stage Online Algorithm 

In this section, we propose a two-stage online algorithm to 
minimize the right-hand-side of the drift-plus-penalty bound 
(ITTb at every slot t as follows, 

1. At each time t observe: Z(t), Q(t), p(t), 7 (i), S(t), 
A s (t) and A e (t). 

2. Then solve the following optimization problem to obtain 
the decision variables {G* e (t), G*(t), S*(t), S*(t)}: 

min VC(t) - (g(t) + Z{t)\\G s (t) + S s (t) 

subject to constraints (fTTT i. Sl2\ . 1131 . 

3. Then update the queue equations for next time slot, 

Q(t + 1) = max \Q(t)-G*{t) - S* s {t),o\ + A s {t), 



Z(t + 1) = max <^ Z(t) - G* s {t) - S*(t) + el 
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Using this algorithm, the problem is decoupled in time. Also 
we do not require any information about the future values or 
the expectations. In addition, we observe that the electricity 
served for essential loads G s (t) and S e (t) are independent 
with that for shiftable load in the above formulation. Hence, 
our problem can be separately solved in two stages. In stage I, 
we will minimize the cost and only introducing essential load 
as the input; In stage II, we solve the optimization problem 
for shiftable load. 

1 ) Stage I, Optimization for Essential Load: At each time 
slot the instantaneous optimization problem is, 

min VC(t)~ { Q(t) + Z(t)X{ G s {t) + S s {t) 

subject to constraints ([Til l. H2i . ([T3l >. Rearranging the terms in 
the above objective function we get the following optimization 
problem for the essential load, 



min V[p(t)G e (t)+ 7 (t)S e (t) 



subject to, 



G e (t) + S e (t) = A e (t), Vi. 



(18) 



(19) 



Replace G e (t) — A e (t)—S e (t) in the above objective function, 
we get the following unconstrained optimization problem in 
only one variable, 

(20) 
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From this equation it is obvious that for cost minimization we 
should adopt the following strategy, 

r*(t\ = I ^ = min ( G max,A e (t)), if p(t) < ~/(t) 

UA) \ max(A e (t)-S,0), if p(t) > 7 (t). 1 



(17) 



sm = 



S = min (S(t),A e (t)), if 7 (i)<p(t) 
max(A e (t) - G,0), ifj(t)>p(t). 



(22) 



This result is very simple and it says that we should use 
maximum power from the grid if the price of purchasing 
electricity is less than price of selling renewable electricity 
back to the grid. Otherwise utilize maximum power from the 
renewable source to satisfy the essential load demands. We 
assume that there is always enough power available to serve 
the essential demands in any time slot. 

2) Stage II, Optimization for Shiftable Load: Once the 
decision on G* (i) and S* (i) for essential load are obtained we 
have to decide about the remaining renewable and grid power. 
The power that is available for shiftable demands is, 

5 max = ma X (5(t)-5*(t),0), (23) 

G max = max(G mQX - G* e (t), 0). (24) 

The objective function for the shiftable problem now contains 
the remaining terms and the remaining constraints. After 
some re -arrangement of terms in the objective function the 
instantaneous optimization problem to obtain variables G s (t) 
and S s (t) is now as follows, 

Gs min jc? s (t) (v P {t) - (Q(t) + Z{t))\ j + 

is s (t)(v 7 (t)-(Q(t) + Z(t)fjX (25) 

subject to constraints J23l . (l24l . We can then decide the 
optimum variables based on appropriate threshold type policy. 

C. Real-Time Distributed Decision 

There are four possible cases depending on the current 
prices and queue states. 

1) Case I: Vp(t) > Q{t) + Z{t) andVj{t) > Q(t) + Z(t): 
This situation indicates any or all of the following: 

• the queue lengths are small 

• for given V, p(t) is large i.e. price of buying electricity 
from grid is high 

• for given V, j(t) is large i.e. price of selling electricity 
to grid is high 

In this situation (also evident from the objective function), 
shiftable load should not be scheduled and instead we should 
sell all the electricity to the grid i.e. 

G* s (t) = o, s* s (t) = o, s;(t) = s max . 

2) Case II: Vp(t) > Q(t) + Z(t) andVj(t) < Q(t) + Z(t): 
This situation is possible when p(t) > j(t). In this case, we 
should serve the shiftable queue using renewable energy only. 
The shiftable queue should not be served from the grid and any 
remaining renewable energy left after servicing the shiftable 
queue should be sold to the grid. 

<?:(*) = o, 

S*(t) = min(S max ,Q(t)), 



3) Case III: Vp(t) < Q{t) + Z{t) and Vj(t) > Q{t) + 
Z(t): This situation is possible when p(t) < j(t). This case 
results in a situation where the customer would sell all the 
renewable electricity to the grid and purchase electricity from 
the grid to serve the shiftable demands in the queue. However, 
to prevent users to buy energy from the grid and sell it back, 
a rational pricing model will make sure that p(t) will never 
less than ^(t). Hence, this case will not happen. 

4) Case IV: Vp(t) < Q(t)+Z(t) andVj(t) < Q(t)+Z(t): 
This situation means any or all of the following: 

« queue thresholds are high 

« price of electricity from grid is low 

> price offered by grid for renewable energy is also low 
In this case we should serve the queue using the energy from 
the grid as well as the renewable source. For this situation we 
have two further sub-cases: 

Sub-case I (if p(t) > j(t)): in this case, the consumers use 
maximum energy from the renewable source to serve shiftable 
loads. The remaining demands in the queue should then be 
served using grid energy. If some renewable energy remains 
after servicing the queue then it should be sold to the grid. 

S*(t) = mm(S ma x,Q(t)), 

G* s (t)=mm{Q(t)-S* s {t),G max ), 

S*(t) = max.(S max - S*(t), 0). 

Sub-case II (if p(t) < ^(t)): Based on the same reason 
expressed in Case III, this case also will not happen. 

V. The Simulation Analysis 

We consider 10 customers (homes) and each customer is 
selected to have 20 essential appliances and 20 shiftable 
appliances. We have a set up similar to ATI , where the 
essential appliances may include electric stoves (daily usage 
E: 1.89 kWh for self-cleaning and 2.01 kWh for regular), 
lighting (daily usage for 10 standard bulbs: 1.00 kWh). Based 
on this set up, the essential load A e (t) for each hour can be 
obtained. The shiftable appliances may include dishwashers 
(daily usage E: 1.44 kWh), washing machines (daily usage 
E: 1.49 kWh for energy-start, 1.94 kWh for regular) and 
clothes dryers (daily usage E: 2.50 kWh). To describe the 
time-varying characteristic of the shiftable load, we model 
the shiftable demand A s (t) as i.i.d. over slots and uniformly 
distributed over the integers {0, 1, • • • , A sjnax }. We assume 
that market prices for purchasing electricity from the grid is 
p(t) = 0.3 cents at daytime hours, i.e., from 8:00 in the 
morning to 12:00 at night and p(t) — 0.1 cents during the 
night, i.e., from 12:00 at night to 8:00 AM the day after. 
Meanwhile, the selling price is set at ^(t) = 0.2 cents during 
daytime hours and -f(t) —0.1 cents during the night. 

A. Electricity Cost 

We compare the proposed bidirectional transaction scheme 
with dynamic programming (BTS-DP) and Lyapunov opti- 
mization (BTS-LO) against a simple "Purchasing Only Strat- 
egy (POS)" which tries to use all the available renewable 



resource S(t) and only buy from the market as a last resort 
if the produced renewable energy cannot satisfy the current 
essential and shiftable load. Fig. Q] shows the cumulative 
electricity costs in different power transaction schemes. It 
is shown that the energy costs achieved by the proposed 
bidirectional transaction schemes are less than that in the 
POS. This is because the proposed schemes are not only 
able to sell the produced renewable energy to the grid to 
obtain financial credits, but also schedule the shiftable loads 
to the lower electricity price periods to reduce electricity 
consumption costs. We note that the total electricity cost in 
the BTS-LO case is higher than that in the BTS-DP. That is, 
the BTS-LO is a distributed online optimization and requires 
less information than BTS-DP. However, we can obtain the 
different costs in BTS-LO by adjusting the parameters V and 
e, which is related to the delay suffered by shiftable load. 
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Fig. 1. Electricity cost in terms of different power transaction schemes. 

B. Delay 

To illustrate the delay in the proposed scheme, we use logm 
(Actual Demand Queue (Q)) to compare the delay between 
BTS-DP with infinite delay constraint and BTS-LO with delay 
constraint (D max ). The delay in terms of different scenarios 
have shown in Fig. [2] In Fig. [2 it is note that the logio (Actual 
Demand Queue (Q)) has the highest value in the dynamic 
programming solution, as it achieves the lowest energy cost. 
In addition, selecting different parameters V and e in real- 
time algorithm BTS-LO, we can adjust the delay and achieve 
corresponding electricity costs (as shown in Fig. [TJ, and thus, 
achieve various tradeoff of the consumers' electricity usage 
preference: power consumption vs delay tolerance. 

VI. Conclusion 

In this paper, we presented a bidirectional power transaction 
mechanism to minimize the electricity cost in the residential 
smart grid. According to the endurance of the serving delay, 
the residential load is classified into two types: essential load 
and shiftable load. In order to satisfy both of the loads, 
consumers can purchase the power from grid or use the 
produced renewable power. Since the consumers also can sell 
the produced renewable power to grid for benefit, the shiftable 
load can be stacked in a queue, given that it will be served 
within a pre-agreed deadline. To decide the amount of electric- 
ity consumed, sold and purchased, we then formulate a global 
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Fig. 2. Delay comparison between the bidirectional transaction scheme with 
dynamic programming and Lyapunov optimization. 

centralized optimization problem and provide a distributed 
online algorithm by using Lyapunov optimization solution. 
Simulations confirms that our proposed mechanism is able 
to balance the tradeoff between the power consumption and 
the allowable delay in the residential networks. Meanwhile, 
the effectiveness of distributed online algorithms with limited 
information is compared with the bound provided by the 
centralized off-line algorithm with global information. 
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